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CAMERA OPERATION APPARATUS 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to a camera control 

system capable of remote-controlling a camera via a 
network . 

Related Background Art 

A video image transmission system has recently 
10 been proposed, which transmits a video image from a 
video camera connected via a network such as the 
Internet to a plurality of clients ( computer terminal 
stations) . 

A camera control system capable of controlling the 
15 functions such as panning, tilting, and zooming added 
to the video camera from a camera operation apparatus 
(client) via a network has also been proposed. A video 
camera added with new functions in addition to panning, 
tilting, and zooming or a video camera operating in a 
20 control mode different from a conventional one have 
been developed these days. A plurality of kinds of 
video cameras are being connected to -the present 
network . 

When the video cameras having different control 
25 modes are connected to the network, a camera operation 
apparatus and a camera server must execute control 
commands respectively corresponding to these different 
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control modes . 

SUMMARY OF THE INVENTION 

It is an object of the present invention to 
5 provide a camera control system flexibly coping with 
control of the plurality of kinds of video cameras 
described above. 

In order to achieve at least one object described 
above, according to an aspect of the present invention, 
10 there is provided a camera operation apparatus for 
operating a camera via a network, comprising: 

storage means for storing at least one module for 
generating a control command for the camera in 
accordance with each kind of camera ; 
15 recognition means for recognizing information 

associated with a kind of camera subject to control ; 

selection means for selecting a module for 
generating the control command for the camera from the 
at least one module, on the basis of the information 
20 associated with the kind of camera recognized by the 
recognition means; and 

module request means, connected to the network, 
for requesting through the network, a transmission of 
the module corresponding to the kind of camera 
25 recognized by the recognition means to a device having 
the module corresponding to the kind of camera 
recognized by the recognition means, when said camera 



- 3 - 



operation apparatus has no module corresponding to the 
kind of camera recognized by the recognition means. 

According to an another aspect of the present 
invention, there is provided a camera operation 
5 apparatus for operating a camera via a network, 
comprising: 

storage means for storing at least one module for 

generating a control command for the camera in 

accordance with each kind of camera; 
10 recognition means for recognizing information 

associated with a kind of camera subject to control; 
selection means for selecting a module for 

generating the control command for the camera from the 

at least one module, on the basis of the information 
15 associated with the kind of camera recognized by the 

recognition means; and 

display means for displaying a window for 

operating the camera, on the basis of the module 

selected by the selection means, 
20 wherein the display means changes at least display 

contents for operation in said window in accordance 

with a kind of camera. 

According to a still another aspect of the present 

invention, there is provided a camera server for 
25 controlling a camera on the basis of a control 

instruction received from a camera operation apparatus 

via a network, comprising: 



determination means for determining whether the 
camera operation apparatus can control the camera when 
a camera control right request is received from said 
camera operation apparatus; and 

output means for outputting a camera control right 
obtaining notice to the camera operation apparatus and 
information associated with the kind of camera together 
with the notice when the determination means determines 
that the camera operation apparatus can control the 
camera . 

According to a still another aspect of the present 
invention, there is provided a camera operation method 
of operating a camera via a network, comprising the 
steps of: 

storing at least one module for generating a 
control command for the camera in accordance with each 
kind of camera; 

recognizing information associated with a kind of 
camera subject to control; 

selecting a module for generating the control 
command for the camera from the at least one module, on 
the basis of the information associated with the kind 
of camera recognized in the recognizing step; and 

requesting through the network, transmission of 
the module corresponding to the kind of camera 
recognized in the recognizing step to a device having 
the module corresponding to the kind of camera 



recognized in the recognizing step, when there is no 
module corresponding to the kind of camera recognized 
in the recognizing step. 

According to a still another aspect of the present 
invention, there is provided a camera operation method 
of operating a camera via a network, comprising the 
steps of: 

storing at least one module for generating a 
control command for the camera in accordance with each 
kind of camera; 

recognizing information associated with a kind of 
camera subject to control; 

selecting a module for generating the control 
command for the camera from the at least one module, on 
the basis of the information associated with the kind 
of camera recognized in the recognizing step; and 

displaying a window for operating the camera, on 
the basis of the module selected in the selecting step, 

wherein said displaying step changes at least 
display contents for operation in said window in 
accordance with a kind of camera. 

According to a still another aspect of the present 
invention, there is provided a storage medium for 
storing a computer-readable program for executing a 
camera operation processing comprising the steps of: 

storing at least one module for generating a 
control command for the camera in accordance with each 
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kind of camera; 

recognizing information associated with a kind of 
camera subject to control; 

selecting a module for generating the control 
5 command for the camera from the at least one module, on 
the basis of the information associated with the kind 
of camera recognized in the recognizing step; and 

requesting through the network, transmission of 
the module corresponding to the kind of camera 
10 recognized in the recognizing step to a device having 
the module corresponding to the kind of camera 
recognized in the recognizing step when there is no 
module corresponding to the kind of camera recognized 
in the recognizing step. 
15 According to a still another aspect of the present 

invention, there is provided a storage medium for 
storing a computer-readable program for executing a 
camera operating processing comprising the steps of: 

storing at least one module for generating a 
20 control command for the camera in accordance with each 
kind, of camera; 

recognizing information associated with a kind of 
camera subject to control; 

selecting a module for generating the control 
25 command for the camera from the at least one module, on 
the basis of the information associated with the kind 
of camera recognized in the recognizing step; and 
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displaying a window for operating the camera, on 
the basis of the module selected in the selecting step, 

wherein said displaying step changes at least 
display contents for operation in said window in 
5 accordance with a kind of camera. 

According to a still another aspect of the present 
invention, there is provided a storage medium for 
storing a computer-readable program for executing a 
camera control processing comprising the steps of: 
10 determining whether the camera operation apparatus 

can control the camera when a camera control right 
request is received from a camera operation apparatus 
via a network; and 

outputting a camera control right obtaining notice 
15 to the camera operation apparatus and information 

associated with the kind of camera together with the 
notice when it is determined in the determining step 
that the camera operation apparatus can control the 
camera . 

20 The above and other objects, features, and 

advantages of the present invention will be apparent 
from the following detailed description of the 
preferred embodiments in conjunction with the 
accompanying drawings . 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a camera control 



- 8 - 



system according to the first embodiment of the present 
invention; 

Fig. 2 is a block diagram showing a camera control 
system as a modification of the embodiment shown in 
5 Fig. 1; 

Fig. 3 is a block diagram showing the arrangement 

of a camera server of this embodiments- 
Fig. 4 is a block diagram showing the arrangement 

of a client of this embodiment; 
10 Fig. 5 is a view showing a display window of a 

display device 212; 

Fig. 6 is a view showing software of the camera 

control system of this embodiment; 

Fig. 7 is a display window for setting camera 
15 parameters for a camera server 101 at a camera 

management terminal station 100; 

Fig. 8 is a flow chart showing an operation 

sequence of the camera management terminal station 100 

of this embodiment; 
20 Fig. 9 is a flow chart showing an operation 

sequence of a client 102 of this embodiment; 

Fig. 10 is a block diagram showing a camera 

control system according to the second embodiment of 

the present invention; 
25 Fig. 11 is a flow chart showing an operation 

sequence of a camera server 101 of the embodiment shown 

in Fig. 10; 
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Fig. 12 is a flow chart showing an operation 
sequence of a client 102 according to the third 
embodiment of the present invention; 

Fig. 13 is a block diagram showing a modification 
5 of the embodiment shown in Fig. 12; 

Fig. 14 is a view showing a display window of the 
display device 212 of the first and third embodiments; 

Fig. 15 is a view showing another display window 
of the display device 212 of the first and third 
10 embodiments; and 

Fig. 16 is a view showing still another display 
window of the display device 212 of the first and third 
embodiments . 



15 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The preferred embodiments of the present invention 
will be described with reference to the accompanying 
drawings . 

Fig. 1 is a block diagram showing a camera control 
20 system according to the first embodiment of the present 
invention. This system comprises camera servers 101, 
clients 102, and camera devices 103. In each camera 
device 103, the image sensing direction of panning or 
tilting can be controlled, and zooming can also be 
25 controlled by controlling the pulse count of a zoom 
lens (not shown). 

Each of the camera server 101 and client 102 is 
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made up of an information processing device such as a 
computer , which is connected to a network such as the 
Internet or an intranet. In the camera system of this 
embodiment, a request is sent from each client 102 to 
5 each camera server 101 via the network and is accepted, 
video image data is distributed from this camera server 
101 to the corresponding client 102. The video image 
picked up by the camera device 103 can be observed in 
this client 102. A camera control command is sent from 

10 each client 102 to each camera server 101 to allow 
zooming, panning, and titling in the corresponding 
camera device 103. Each client 102 selects a desired 
one of the plurality of camera servers 102 ( in 
practice, the client selects the camera device 

15 connected to the camera server). 

A camera management terminal station 100 provides 
setting information to the respective camera devices 
connected to the network in start-up of the camera 
devices. Note that the camera management terminal 

20 station 100 may be incorporated in any one of the 
camera servers 101 or in each camera server 101. 

Fig. 2 shows a modification of the camera control 
system shown in Fig. 1. This system incorporates a 
popular Web technique and must have a WWW (World Wide 

25 Web) server 105 connected to the network. Web page 

data in the WWW server 105 has links representing the 
correspondence between specific addresses and specific 
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camera servers. The WWW server 105 can be easily 
connected to a desired camera server. 

In the WWW, a server using another protocol is 
accessed directly or via a gateway and the access 
5 result is presented to the user in the form of a 
hypertext. A WWW browser sends information in 
accordance with an URL (Uniform Resource Locator) 
representing the storage destination of subject data to 
the WWW server serving as the storage destination of 

10 documents and image data. In response to this, the WWW 
server sends back the corresponding document and image 
data to the WWW browser. 

Fig. 3 is a block diagram showing the hardware 
arrangement of the camera server 101 and camera device 

15 103. As shown in Fig. 3, this arrangement is comprised 
of a secondary storage device 105 such as a hard disk 
or ROM storing predetermined programs, a memory (RAM) 
106, a video image capture board 107 for capturing 
video image data from the camera device 103, a camera 

20 I/F 108 for sending a control command to the camera 
device 103, a network I/F 109 for connecting the 
network and the camera server, a CPU 110 for executing 
various processes based on the programs, and an 
external storage device 115 for loading external 

25 programs. 

A keyboard 113 and a mouse 114 can input control 
instructions in controlling the camera device 103 on 
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the camera server 101 side. A peripheral controller 
116 receives signals input from the keyboard 113 and 
mouse 114. An image signal picked up by the camera 
device 103 is converted into a predetermined signal via 
5 a display board 111. A display device 112 displays an 
image on the basis of the converted signal. 

Fig. 4 shows a hardware arrangement of the client 
102. The client 102 is comprised of a secondary 
storage device 205 such as a hard disk or ROM storing 

10 programs, a memory (RAM) 206, a network I/F 209 for 
connection to the network, a CPU 210 for executing 
various processes based on programs, an external 
storage device 215 for loading external programs, a 
mouse 214 and keyboard 213 for inputting control 

15 instructions for the camera device 103 connected to the 
network via the camera server 101, a peripheral 
controller 216 for receiving input signals from the 
mouser 214 and keyboard 213, a display device 212 for 
displaying an image picked up by the camera device, and 

20 a display board 211 for converting a signal sent from 
the camera server into a predetermined signal in order 
to display the image on the display device 212. 

Fig. 5 shows the window displayed on the display 
device 212 of the client 102 of this embodiment. A 

25 video image display area 136 displays an image picked 
up by the camera device 103. A bar 131 controls 
zooming in the camera device 103. The bar 131 is moved 
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upward with the mouse 214 to control zooming toward the 
telephoto side. The bar 131 is moved downward with the 
mouse 214 to control zooming toward the wide-angle 
side. 

A bar 132 controls a tilt direction in image 
sensing with the camera device 103. When the bar 132 
is moved vertically with the mouse 214, the image 
sensing direction of the camera device 103 can change 
vertically accordingly. 

A bar 133 controls the pan direction in image 
picked up by the camera device 103. When the bar 133 
is dragged horizontally with the mouse 214, the 
orienting direction of the camera device 103 can change 
horizontally accordingly. A button 134 is used to 
request the control right for the camera device 103 to 
the camera server 101. When this button 134 is 
clicked, the list of the camera devices 103 connected 
to the network is displayed. The user can select a 
desired camera device from the list and can designate 
the control right for the selected camera. The window 
also includes a back light correction button 135, and a 
cancel button 137 serving as an end button for ending 
control of the camera device 103 under control. 

The window in Fig. 5 is a GUI (Graphical User 
Interface) for inputting camera control instructions, 
as described above. An image is displayed on the video 
image display area 136 on the basis of the video image 
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data obtained from the camera server 101. Operation 
instructions from the bars 131 to 133 and operation 
buttons are sent to the camera server 101. 

Fig. 6 shows the software of the camera control 
system of the embodiment described above. 

Referring to Fig. 6, a camera control server 301 
of the camera server 101 can control a camera device 
103A or a camera device 103B different from the kind of 
the camera device 103A in accordance with a control 
instruction transmitted from the client 102 via the 
network. The camera control server 301 operates using 
a module corresponding to the kind (function) of the 
camera device 103A or 103B. A video image server 302 
processes a video signal output from the camera device 
103 connected to it. More specifically, the video 
image server 302 converts an analog video signal such 
as an NTSC signal output from the camera device 103 
into an RGB or YUV image signal. The video image 
server 302 also compresses the RGB or YUV image signal 
into compressed data in accordance with an existing 
compression scheme such as MPEG or Motion- JPEG. No 
specific limitation is imposed on the compression 
means. H.261 or H.263 can also be used. In Fig. 6, 
the camera device 103A is connected to the camera 
server 101 for the illustrative convenience. 

The client 102 is comprised of a camera control 
unit 303 for executing a control command of a desired 
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camera device connected to the network, and a video 
image display unit 304 for displaying a video image on 
the display screen of the display device 212 by 
performing expansion and the like of the video image 
5 data received from the network. The camera control 

unit 303 has modules respectively corresponding to the 
camera devices 103 connected to the network, selects a 
module necessary for the target camera device, and 
executes a control command generation process 
10 corresponding to the target camera device using the 
selected module. 

In Fig. 6, one camera management terminal station 

100, one camera server 101, and one client 102 are 
connected on the network for the illustrative 

15 convenience. However, a plurality of camera management 
terminal stations 100, a plurality of camera servers 

101, and a plurality of clients 102 may be also 
connected on the network. 

A camera control server management unit 305 and a 
20 video image server management unit 306 in the camera 
management terminal station 100 store setting 
information (to be described later) of the camera 
devices 103 in the network for each kind of camera 
device. 

25 Fig. 7 is a display window of the camera 

management terminal station 100 to set camera 
parameters used in the camera control server 301 in a 
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specific file (system database such as a registry 
depending on an OS). Fig. 8 is a flow chart for 
setting the camera parameters of the camera server 101 
in the network on the camera management terminal 
5 station 100. 

In step S101 of Fig. 8, when the camera management 
terminal station 100 is started up, the setting 
information of camera parameters associated with the 
current camera control server 301 and video image 

10 server 302 is read out from a specific file (e.g., the 
registry file of the OS) on a machine operating the 
camera control server 301 and video image server 302 
via the network. The readout setting information is 
displayed on the display window, as shown in Fig. 7. 

15 Setting modules (Dynamic Link Libraries depending on an 
OS) are prepared for each kind of camera device. When 
the camera server 101 is newly started up, the kind of 
camera device connected to the network is specified to 
link the camera parameters of the started camera 

20 device. 

In step S102, when the system supervisor inputs a 
camera parameter on the window in Fig. 7, the flow 
advances to step S103. If the supervisor's operation 
is not selection of the OK button, the flow advances to 

25 step S104 to check if the input camera parameter is 

proper. If NO in step S104, the flow advances to step 
S105 to output an error message. If YES in step S104, 
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the flow advances to step S106 to update the display 
screen. 

When it is determined in step S103 that the 
supervisor selected the OK button in step S102, the 
5 flow advances to step S107 to update the data (camera 
parameter) in. the memory of the camera management 
terminal station 100. The flow advances to step S108, 
and the camera management terminal station 100 outputs 
the camera parameter corresponding to the connection 

10 destination camera server 101 to the specific file on 
the machine in which the camera control server 301 and 
the video image server 302 are currently operating via 
the network. More specifically, the camera management 
terminal station 100 inguires the kind of camera device 

15 (the camera device A in Fig. 6) to which the camera 

server 101 is currently connected. The camera 
management terminal station 100 then selects and 
outputs the camera parameter corresponding to the 
module with which the camera control server 301 is 

20 currently operating. 

The flow then advances to step S109 to determine 
in the camera management terminal station 100 whether 
the camera server 101 is restarted up to reflect the 
output camera parameter. If YES in step S109, the flow 

25 advances to step S110 to perform restart-up processing 
of the camera server 101. If NO in step S109, the 
processing is directly ended. 



- 18 - 



The camera parameters which can be set in the 
camera management terminal station in this embodiment 
are a camera control communication TCP port number, a 
serial port number of the serial port connected to the 
5 camera device 103, a shutter speed, the 

presence/absence of camera control-associated log 
information and a log file name, a frame rate which 
defines a video image capture time interval, 
compression quality of a video image signal, a maximum 

10 time for which one client can control the camera device 
103, and the like. 

Fig. 9 is a flow chart showing an operation 
sequence on the client 102 side of this embodiment. 

It is determined in step S201 whether the control 

15 right for the camera device 103 is requested to the 
camera server 101. If a control right obtaining 
request is performed on the window in Fig. 5, the flow 
advances to step S202, and the client 102 waits until a 
notice representing whether the control right for the 

20 camera device 103 is obtained is sent from the camera 
server 101. If it is confirmed by the transmitted 
notice that the control right for the camera device 103 
cannot be obtained, the flow returns to step S201; 
otherwise, the flow advances to step S203 . 

25 In step S203, the client 102 confirms the kind 

(function) of the camera device 103 currently connected 
to the camera server 101 on the basis of data 



- 19 - 



associated with the kind of the camera device 103 
currently connected to the camera server 101, which 
data is contained in the control right obtaining notice 
data transmitted from the camera server 101. 
5 The flow advances to step S204, and the camera 

control unit 303 selects a module corresponding to the 
kind (function) of the confirmed camera device 103. 
Since the camera device connected to the camera server 

101 is the camera device 103A in Fig. 6, the module for 
10 the camera device 103A is selected, and the flow 

advances to step S205. The operation of the camera 
control unit 303 is started on the basis of the 
selected module to allow control of the camera device 
103A. 

15 In step S206, the control time for the camera 

device 103A becomes almost the time limit or the client 

102 releases the camera control right, control of the 
camera device 103A is completed. 

As described above, according to this embodiment, 
20 the module for operating the camera control unit 303 is 
automatically switched depending on the kinds of camera 
devices to be controlled. The user need not search for 
the module of the camera control unit 303 corresponding 
to the kind of currently connected camera device. 
25 The second embodiment of the present invention 

will exemplify a camera control system in which a new 
kind of camera is connected to a camera server 101. 
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Fig. 10 is a block diagram of the camera control 
system according to the second embodiment. As shown in 
Fig. 10, a module management server 104 is connected on 
the network. This module management server 104 has a 
plurality of modules respectively corresponding to all 
kinds (functions) of camera devices 103. The plurality 
of modules are selectively distributed to the camera 
server 101, a client 102, and a camera management 
terminal station 100. The plurality of modules in the 
module management server 104 can cope with functional 
differences in control command formats of the different 
camera devices 103, image sensing direction control 
ranges of the camera devices 103 or presence/absence of 
control, drive limit of zoom magnification, 
presence/absence of driving, or presence/absence of the 
back light correction function, and the like. The 
module management server 104 may define the 
distributable management range of its modules on the 
network. In this case, a plurality of module 
management servers 104 are connected on the network and 
distribute the modules to the camera servers 101, 
clients 102, camera management terminal stations 100, 
and the like located within the management ranges of 
these servers 104. 

The arrangement of the camera server 101, client 
102, and the camera management terminal station 100 of 
the second embodiment is substantially the same as that 
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of the first embodiment, and a detailed description 
thereof will be omitted. 

Fig. 11 is a flow chart showing an operation 
sequence of the camera server 101 when the camera 
device 103 is newly connected to the camera server 101. 
The second embodiment will be described with reference 
to Fig. 11. 

In step S301, when the camera device 103 is newly- 
connected to the camera server 101 (the camera 103C in 
Fig. 10), the flow advances to step S302 to determine 
whether there is a module corresponding to the 
connected camera device 103. In this case, the 
following determination methods can be used. The 
modules in a camera control server 301 in the camera 
server 101 are operated individually, and whether there 
is the module corresponding to the connected camera 
device is determined based on the return results from 
the connected camera device 103. Alternatively, the 
supervisor inputs information associated with the kind 
(function) of the connected camera device 103 in the 
camera server, and whether there is the module 
corresponding to the connected camera device is 
determined on the basis of the input result. According 
to a still alternative method, the modules of the 
module management server 104 are operated individually, 
and the kind of the connected camera 103 is determined 
on the module management server 104 side. 
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When it is determined that there is the module 
corresponding to the currently connected camera device 
103 in the camera control server 301, the flow returns 
to step S301. The camera control server 301 is kept 
5 operated until the current module outputs a change in 
correction of the new camera device 103. 

If NO in step S302, the flow advances to step S303 
to request a module corresponding to the currently- 
connected camera device 103 (the camera device 103C in 

10 Fig. 10) to the module management server 104. 

In step S304, when the requested module is 
received from the module management server 104, the 
flow advances to step S305 to perform restart-up 
processing in the camera server 101. The camera 

15 control server 301 can be operated by the module (the 
module corresponding to the camera 103C in Fig. 10) 
corresponding to the currently connected camera device 
103. In step S304, the module management server 104 
also outputs the module corresponding to the camera 

20 device 103C to the camera management terminal station 
100. This allows operating the camera management 
terminal station 100 in correspondence with the camera 
device 103C. 

As described above, according to the second 

25 embodiment, even if the camera server 101 does not have 
a module corresponding to the newly connected camera 
device, the camera server 101 can obtain the 
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corresponding module from the module management server 
104 connected on the network. Therefore, when the new 
kind of camera device 103 is connected, this camera 
device can be immediately and easily operated. 

The third embodiment of the present invention 
allows a client 102 to control a camera device 103 in 
the camera control system of the second embodiment. 
The arrangement of a camera server 101, the client 102, 
and a camera management terminal station 100 is 
substantially the same as that of the first and second 
embodiments, and a detailed description thereof will be 
omitted. 

Fig. 12 is a flow chart showing an operation 
sequence of the client 102 when the client 102 requests 
a control right for an arbitrary camera device. The 
third embodiment will be described with reference to 
Fig. 12. 

The client 102 determines in step S401 whether the 
control right for the camera device 103 is requested to 
the camera server 101 . When the request for obtaining 
the control right is made on the window in Fig. 5, the 
flow advances to step S402, and the client 102 waits 
until a notice representing whether the control right 
for the camera device 103 is obtained is transmitted 
from the camera server 101. If no control right for 
the camera device 103 is obtained, the flow advances to 
step S402a. The client 102 receives from the camera 
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server 101 a notice representing that the control for 
the camera server 103 is not obtained. 

In step S403, the client 102 confirms the kind 
(function) of the camera device 103 connected to the 
5 target camera server 101 on the basis of the control 
right obtaining notice transmitted from the camera 
server 101 or data associated with the kind of camera 
device 103 currently connected to the camera server 
101, which data is transmitted together with notice 

10 data representing that the control right cannot be 

obtained. In this case, the information received by 
the client contains information associated with the 
control command of the camera device 103 and the 
presence/absence of the function of the camera device 

15 103. 

The flow then advances to step S404. When the 
module (for the camera device 103C in Fig. 10) 
corresponding to the kind (function) of the target 
camera device 103 cannot be confirmed, the flow 

20 advances to step S405 to request the module management 
server 104 to transmit the corresponding module. When 
the client 102 receives the module corresponding to the 
target camera device 103 from the module management 
server 104, the flow advances to step S407. If the 

25 control right for the target camera device 103 is 
obtained, the flow advances to step S408 to allow 
control of the camera device 103; otherwise, the flow 
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returns to step S401. 

The client 102 confirms that the module ( for the 
camera device 103C in Fig. 10) corresponding to the 
kind (function) of the target camera device 103 is 
5 stored in a camera control unit 303, the flow advances 
to step S407. When the control right is obtained, the 
currently connected camera device 103 can be 
controlled. 

In step S408, when a cancel button 137 is pressed, 

10 or the control time for the currently connected camera 
device 103 reaches the time limit, control of the 
camera device 103 is completed. 

As described above, according to this embodiment, 
even if the client 102 does not have the module 

15 corresponding to the target camera device 103 in camera 
control, the client 102 can receive the module 
corresponding to the target camera device 103 from the 
module management server 104 via the network, thereby 
allowing the client 102 to immediately control the 

20 camera device 103. 

In the above embodiment, the camera server 101, 
the module management server 104, and the camera 
management terminal station 100 are independently 
connected to the network. However, as shown in 

25 Fig. 13, each camera server 101 may have the functions 
of the module management server 104 and camera 
management terminal station 100. In this case, 
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processes between the camera server 101, module 
management server 104, and camera management terminal 
station 100, which have been performed via the network, 
are executed in the camera server 100. The client 102 
5 requests the camera server 101 connected to the 

currently connected camera device 103 to transmit the 
module corresponding to the currently connected camera 
device 103. 

In the first and third embodiments, when the 
10 module corresponding to the kind of camera device 103 

is selected on the client 102 side, the display mode of 
the operation buttons in the window displayed on the 
display device 212 shown in Fig. 5 changes. 

For example, as compared with the mode shown in 
15 Fig. 5, when the camera device 103 does not have the 

back light correction function, a window having no back 
light correction button 135 is displayed by the module 
corresponding to this camera device 103, as shown in 
Fig. 14. 

20 For example, when the camera device 103 has 

neither the zoom function nor the back light correction 
function, a window having neither display elements 
associated with the zoom function nor the back light 
correction button 135 is displayed by the module 

25 corresponding to this module 103, as shown in Fig. 15. 

For example, when the camera device 103 does not 
have the tilt function, zoom function, and back light 
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correction function, a window having no bars 132 and 
131, display elements associated with the zoom 
function, and the back light correction button 135 is 
displayed by the module corresponding to this camera 
5 device 103, as shown in Fig. 16. 

Since the window contents change depending on the 
selected modules in accordance with the camera 
functions as described above, the user can perform 
appropriate operations. 

10 The object of the present invention is realized 

even by supplying a storage medium storing software 
program codes for realizing the functions of the 
above-described embodiments to a system or an 
apparatus, and causing the computer (or a CPU or an 

15 MPU) of the system or the apparatus to read out and 

execute the program codes stored in the storage medium. 

In this case, the program codes read out from the 
storage medium realize the functions of the 
above-described embodiments by themselves, and the 

20 storage medium storing the program codes constitutes 
the present invention. 

As a storage medium for supplying the program 
codes, a floppy disk, a hard disk, an optical disk, a 
magnetooptical disk, a CD-ROM, a CD-R, a magnetic tape, 

25 a nonvolatile memory card, a ROM, or the like can be 
used . 

The functions of the above-described embodiments 
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are realized not only when the readout program codes 
are executed by the computer but also when the OS 
(Operating System) running on the computer performs 
part or all of actual processing on the basis of the 
5 instructions of the program codes. 

The functions of the above-described embodiments 
are also realized when the program codes read out from 
the storage medium are written in the memory of a 
function expansion board inserted into the computer or 
10 a function expansion unit connected to the computer, 

and the CPU of the function expansion board or function 
expansion unit performs part or all of actual 
processing on the basis of the instructions of the 
program codes. 

15 When the present invention is applied to the above 

storage medium, the program codes corresponding to the 
flow charts described above are stored in the storage 
medium. For the sake of descriptive convenience, the 
modules indispensable to the camera control system of 

20 the present invention are stored in the storage medium. 

As has been described above, according to the 
present invention, there can be provided a camera 
control system which can flexibly control all kinds of 
cameras . 

25 Many widely different embodiments of the present 

invention may be constructed without departing from the 
spirit and scope of the present invention. It should 
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be understood that the present invention is not limited 

to the specific embodiments described in the 

specf ication, except as defined in the appended claims. 
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WHAT IS CLAIMED IS: 

1 . A camera operation apparatus for operating a 
camera via a network, comprising: 

storage means for storing at least one module for 
5 generating a control command for the camera in 
accordance with each kind of camera; 

recognition means for recognizing information 
associated with a kind of camera subject to control; 
selection means for selecting a module for 
10 generating the control command for the camera from said 
at least one module, on the basis of the information 
associated with the kind of camera recognized by said 
recognition means; and 

module request means, connected to the network, 
15 for requesting through the network, transmission of the 
module corresponding to the kind of camera recognized 
by said recognition means to a device having the module 
corresponding to the kind of camera recognized by said 
recognition means, when said camera operation apparatus 
20 has no module corresponding to the kind of camera 
recognized by said recognition means. 

2. An apparatus according to claim 1, further 
comprising: 

25 control right request means for requesting a 

control right for the camera to a camera server 
executing control of the camera. 
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wherein the information associated with the kind 
of camera is attached to a control right obtaining 
notice for the camera notified from the camera server 
in response to a request to the control right for the 
5 camera by said control right request means. 

3 . An apparatus according to claim 1 , further 
comprising: 

display means for displaying a window for 
10 operating the camera, on the basis of the module 
selected by said selection means, 

wherein said display means changes at least 
display contents for operation in said window in 
accordance with a kind of camera. 

15 

4. An apparatus according to claim 1, wherein 
said camera operation apparatus allows at least one of 
panning and tilting operations of the camera. 

20 5 . A camera operation apparatus for operating a 

camera via a network, comprising: 

storage means for storing at least one module for 
generating a control command for the camera in 
accordance with each kind of camera; 
25 recognition means for recognizing information 

associated with a kind of camera subject to control; 
selection means for selecting a module for 
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generating the control command for the camera from said 
at least one module, on the basis of the information 
associated with the kind of camera recognized by said 
recognition means; and 
5 display means for displaying a window for 

operating the camera, on the basis of the module 
selected by said selection means, 

wherein said display means changes at least 
display contents for operation in said window in 
10 accordance with a kind of camera. 

6. An apparatus according to claim 5, wherein 
said camera operation apparatus allows at least one of 
panning and tilting operations of the camera. 

15 

7. A camera server for controlling a camera on 
the basis of a control instruction received from a 
camera operation apparatus via a network, comprising: 

determination means for determining whether the 
20 camera operation apparatus can control the camera when 
a camera control right request is received from said 
camera operation apparatus; and 

output means for outputting a camera control right 
obtaining notice to the camera operation apparatus and 
25 information associated with the kind of camera together 
with the notice when said determination means 
determines that the camera operation apparatus can 
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control the camera. 

8. A server according to claim 7, wherein said 
output means outputs a notice representing that the 

5 control right for the camera cannot be obtained to the 
camera operation apparatus and information associated 
with the kind of camera together with the notice when 
said determination means determines that the camera 
operation apparatus can operate the camera. 

10 

9 . A camera operation method of operating a 
camera via a network, comprising the steps of: 

storing at least one module for generating a 
control command for the camera in accordance with each 
15 kind of camera; 

recognizing information associated with a kind of 
camera subject to control; 

selecting a module for generating the control 
command for the camera from said at least one module, 
20 on the basis of the information associated with the 

kind of camera recognized in the recognizing step; and 

requesting through the network, transmission of 
the module corresponding to the kind of camera 
recognized in the recognizing step to a device having 
25 the module corresponding to the kind of camera 

recognized in the recognizing step, when there is no 
module corresponding to the kind of camera recognized 
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in the recognizing step. 



10. A method according to claim 9, further 
comprising the step of : 
5 requesting a control right for the camera to a 

camera server executing control of the camera, 

wherein the information associated with the kind 
of camera is attached to a control right obtaining 
notice for the camera notified from the camera server 
10 in response to a request to the control right for the 
camera in the requesting step. 



11. A method according to claim 9, further 
comprising the step of: 
15 displaying a window for operating the camera, on 

the basis of the module selected in the selecting step, 

wherein said displaying step changes at least 
display contents for operation in said window in 
accordance with a kind of camera. 

20 

12. A method according to claim 9, wherein said 
camera operation method allows at least one of panning 
and tilting operations of the camera. 



25 



13. A camera operation method of operating a 
camera via a network, comprising the steps of: 

storing at least one module for generating a 
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control command for the camera in accordance with each 
kind of camera; 

recognizing information associated with a kind of 
camera subject to a control; 

selecting a module for generating the control 
command for the camera from said at least one module, 
on the basis of the information associated with the 
kind of camera recognized in the recognizing step; and 

displaying a window for operating the camera, on 
the basis of the module selected in the selecting step, 

wherein said displaying step changes at least 
display contents for operation said window in 
accordance with a kind of camera. 

14. A method according to claim 13, wherein said 
camera operation method allows at least one of panning 
and tilting operations of the camera. 

15. A method of controlling a camera server for 
controlling a camera on the basis of a control 
instruction received from a camera operation apparatus 
via a network, comprising the steps of: 

determining whether the camera operation apparatus 
can control the camera when a camera control right 
request is received from said camera operation 
apparatus ; and 

outputting a camera control right obtaining notice 
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to the camera operation apparatus and information 
associated with the kind of camera together with the 
notice when it is determined in the determining step 
that the camera operation apparatus can control the 
5 camera . 

16. A method according to claim 15, wherein the 
outputting step comprises outputting a notice 
representing that the control right for the camera 
10 cannot be obtained to the camera operation apparatus 
and information associated with the kind of camera 
together with the notice when it is determined in the 
determining step that the camera operation apparatus 
can operate the camera. 

15 

17. A storage medium for storing a 
computer-readable program for executing a camera 
operation processing comprising the steps of: 

storing at least one module for generating a 
20 control command for the camera in accordance with each 
kind of camera; 

recognizing information associated with a kind of 
camera subject to control; 

selecting a module for generating the control 
25 command for the camera from said at least one module, 
on the basis of the information associated with the 
kind of camera recognized in the recognizing step; and 
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requesting through the network, transmission of 
the module corresponding to the kind of camera 
recognized in the recognizing step to a device having 
the module corresponding to the kind of camera 
recognized in the recognizing step when there is no 
module corresponding to the kind of camera recognized 
in the recognizing step. 

18. A medium according to claim 17, wherein the 
processing further comprises the step of: 

requesting a control right for the camera to a 
camera server executing control of the camera, 

wherein the information associated with the kind 
of camera is attached to a control right obtaining 
notice for the camera notified from the camera server 
in response to a request to the control right for the 
camera in the requesting step. 

19. A medium according to claim 17, wherein the 
processing further comprises the step of: 

displaying a window for operating the camera, on 
the basis of the module selected in the selecting step, 

wherein display contents for operation in said 
display means are changed by at least the window in 
accordance with a kind of camera. 

20. A medium according to claim 17, wherein the 
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processing allows at least one of panning and tilting 
operations of the camera. 

21. A storage medium for storing a 

5 computer- readable program for executing a camera 
operation processing comprising the steps of: 

storing at least one module for generating a 
control command for the camera in accordance with each 
kind of camera; 

10 recognizing information associated with a kind of 

camera subject to control; 

selecting a module for generating the control 
command for the camera from said at least one module, 
on the basis of the information associated with the 
15 kind of camera recognized in the recognizing step; and 
displaying a window for operating the camera, on 
the basis of the module selected in the selecting step, 

wherein said displaying step changes at least 
display contents for operation in said window in 
20 accordance with a kind of camera. 

22. A medium according to claim 21, wherein the 
processing allows at least one of panning and tilting 
operations of "the camera. 

25 

23 . A storage medium for storing a 
computer-readable program for executing a camera 
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control processing comprising the steps of: 

determining whether the camera operation apparatus 
can control the camera when a camera control right 
request is received from a camera operation apparatus 
via a network; and 

outputting a camera control right obtaining notice 
to the camera operation apparatus and information 
associated with the kind of camera together with the 
notice when it is determined in the determining step 
that the camera operation apparatus can control the 
camera. 

24. A medium according to claim 23, wherein the 
outputting step comprises outputting a notice 
representing that the control right for the camera 
cannot be obtained to the camera operation apparatus 
and information associated with the kind of camera 
together with the notice when it is determined in the 
determining step that the camera operation apparatus 
can operate the camera. 
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ABSTRACT OF THE DISCLOSURE 

It is an object to provide a camera control system 
which can immediately cope with control of a plurality 
of kinds of video cameras. At least one module for 
5 generating a camera control command corresponding to 

each kind of camera is stored. Information associated 
with a kind of camera serving as a control target is 
recognized. A module for generating the camera control 
command is selected from at least one module on the 
10 basis of the information associated with the recognized 
kind of camera. 



^LU 

<2iu 



"X 



^1 
tr 
O 



>- 

DC 
O; 



Q- 
O 



X 



>- 

oca 



X 



o 
tr 
<c 
o 

CQ 
>- 
LU 



X 



gczj 
uj 0 

9=1— 

tuO 

D-O 



X 



LU 

CO 



>- 
oc 

<CLU 

oo> 

LUh-LU 

CO COO 



-Is 

LLI CC — 
UJCOQ 



< 
DC 



LU 

CD 

9<o 

>OCQ 



"x 



<: 

QCLU 
UJO 

S> 
< LU 
OQ 



LU LU 

OO 

>> 
LULU 
QQ 

b=LULU 
=3<< 

_,oo 

gen en 
gEoo 

O LU LU 
O — I — I 

<QQ 

< • • 

O 



8 

CO 



<CQ 

LULU 
OO 

>> 
LULU 

cr QQ 

ass 

co << 

_jOO 

g 



-crrer 
:00 



Q LU LU 



QQ 
OO 



2 



< 

o 



>- 
< 
_J 

Q_ 
CO 
Q 
LU 

s 



o 

LU 

Q 

> 



o 

CO 



/V. 



DC 
LU 

> 

<r 

LU 

CO 

LU 

o 
< 



o 

LU 
Q 

> 



LU O 

P 

<CCO 

DC^ 
LU S 
^DC 
<C LU 
OH 



DC 
LU 
> 
DC 
LU 
CO 



<CQ 

LU LU 
OO 

>> 

LULU 
QQ 

<< 
DC DC 
LULU 
SS 



_i!=oo 

g^U-LL. 

0|lulu 
<c< • • 

OS 



o 

co 



DC 
LU 

Si 

lu; 
co- 

LU* 

or 



LU 

o 
< 



Q< 





CD 
EC 



FIG. 8 



( START ) 

T 

READING AND DISPLAYING 
CURRENT SETTING DATA OF 
CAMERA CONTROL SERVER 
AND VIDEO IMAGE SERVER 



S 



S101 



S102 



RECEIVING 

SUPERVISOR'S 

OPERATION 



/SUPERVISOR 
VOPERATION 



ERROR 



OUTPUT OF k S105 
ERROR 
MESSAGE 




YES 



S107 



UPDATE OF 
PARAMETER 



OKS106 



S108 



OUTPUT OF CAMERA 
PARAMETER 



UPDATE OF 
DISPLAY SCREEN 




RESTART 
PROCESSING OF 
CAMERA SERVER 



( END ) 



FIG. 9 



( START ) 




CONFIRMING KIND OF 
CAMERA DEVICE BEING 
CONNECTED NOW 



S204 

:: c± 

SELECTEING MODULE FOR 
CAMERA DEVICE BEING 
CONNECTED NOW 



S205 



CAMERA DEVICE 
BECOMES CONTROLLABLE 




CD 




FIG. 11 



( START ) 



t C± 

CONNECTION OF 
CAMERA DEVICE 



S301 



S302 

"THERE ^ 
IS MODULE 
CORRESPONDING TO 
^CONNECTED CAMERA^ 
DEVICE 
? 

'NO S303 



YES 



REQUEST OF 

CORRESPONDING MODULE 



S304 



CORRESPONDING 
MODULE IS OBTAINED 

? 

YES S305 



NO 



RESTART-UP PROCESSING 



FIG. 12 



START 



S402a 

C± , 

NOTICE THAT 
CONTROL RIGHT 
IS NOT OBTAINED 





^YES 




S403 








CONFIRMING KIND OF 




CAMERA DEVICE 





S404 



^-^THERE^-C 

IS CORRESPONDING^ 

^^DULEJ^--- 

jTnO S405 



REQUEST OF 

CORRESPONDING MODULE 




CAMERA DEVICE 
BECOMES CONTROLLABLE 





o 




CD 




el 




CO 



CD 

u: 



C [-0 US 



COMBINED DECLARATION AND POWER OF j! ATTORNEY DOCKET: 

ATTORNEY FOR PATENT APPLICATION NO. 

As the below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated 
below next to my name. 

I believe I am the original, first and sole inventor (if only one 
name is listed below) or an original, first and joint inventor (if plural 
names are listed below) of the subject matter which is claimed and for 
which a patent is sought on the invention entitled: 

CAMERA OPERATION APPARATUS 



the specification of which (check one) 
is attached hereto, 
was filed on 



x 



and was amended on 



as application No. 
(if applicable). 



In I hereby state that I have reviewed and understand the contents 

of the above-identified specification, including the claims, as amended 
'by any amendment referred to above. 

'% I acknowledge the duty to disclose information which is material 

%o the examination of the application in accordance with Title 37, Code 
qf Federal Regulations, Section 1.56(a). 

^ I hereby claim foreign priority benefits under Section 119 of 

Title 35, united States Code, of any foreign application (s) for patent 
or inventor's certificate (s) listed below and have also identified below 
any foreign application for patent or inventor's certificate having a 
filing date before that of the application (s) or inventor's certificate (s) 
on which priority is claimed: 



| PRIOR FOREIGN APPLICATIONS 


Filing Date 
day/mo/yr 


Priority Claimed 
under 35 use 119 


COUNTRY 


SERIAL NO. 


Yes 


No 


JAPAN 


10-107845 


17 April 1998 


■ 
























I 1 









C (=o /JUT US 



I hereby claim the benefit under Title 35, United states Code 
Sectxon 120 of any United States application (s) listed below and, insofar 
as the subject matter of each of the claims of this application is not 
disclosed in the prior United States application in the manner provided 
by the first paragraph of Title 35, United states Code, Section 112, I 
acknowledge the duty to disclose material information as defined in 
Title 37, code of Federal Regulations, Section 1.56(a) which occurred 
between the filing date of the prior application and the national or PCT 
international filing date of this application: 



APPLICATION SERIAL NO. 



FILING DATE 
day/mo/yr 



STATUS 

Patented, Pending, Aband. 



I hereby appoint James Js-Saiey, Registration No. 24,158, Herbert 
Sleeker, Registration No. 20,368, John J. Torrente, Registration No. 
26 J3 5 9/ Marylee Jenkins, Registration No. 37,645 and Michael Schwarz, 
Registration No. 33,060 as my attorneys to prosecute this application 
and transact all business in the Patent and Trademark Office connected 
herewith. 

Please address all correspondence to James J. Daley at Robin, 
Bltecker, Daley & Driscoll, 330 Madison Avenue, New York, New York 10017. 
Please direct telephone calls to (212) 682-9640. 

I hereby declare that all statements made herein of my own 
knowledge are true and that all -©£a4ements made on information and belief 
a®? believed to be true; and further that these statements were made with 
the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Section 1001 of Title 
18 of the united states Code and that such willful false statements may 
jeopardize the validity of the application or any patent issued thereon. 



Full Name of Sole or 
First Joint Inventor 

TAISUKE KOBAYASHI 



Inventor's Signature 



30-1-308, Matsugaoka 1-chome, 
Residence Nakano-ku, Tokyo, Japan 



Date 



Citizenship 

JAPAN 



Post Office Address c/o Canon Kabushiki Kaisha 

30-2, Shimomaruko 3-chome, Ohta-ku, Tokyo, Japan 



ciro IJtf^S US 



Full Name of 

Second Joint Inventor 

KENJI MORITA 


Inventor's Signature 


Date 


_ . , 8-27-104 , Tsunashima Higashi 
Residence 4 _ chome , K ohoku-ku, 

Yokohama-shi , Kanagawa-ken, 
Jaoan 


Citizenship 


JAPAN 


•d x. -x^j c /° Canon Kabushiki Kaisha 

Post Office Address 30 _ 2f shimomaruko 3-chome, Ohta-ku, Tokyo, Japan 


Full Name of 

Third Joint Inventor 


Inventor ' s Signature 


Date 


Residence 


Citizenship 


llost Office Address 


JUill Name of 

fourth Joint Inventor 


Inventor's Signature 


Date 


Residence 


Citizenship 


Post Office Address 


Full Name of 

Fifth Joint Inventor 


Inventor's Signature 


Date 


Residence 


Citizenship 


Post Office Address 



